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Self-questioning mechanism which is similar to single spin-flip of Ising model in statistical physics 
is introduced into spatial evolutionary game model. We propose a game model with altruistic 
to spiteful preferences via weighted sums of own and opponent’s payoffs. This game model can 
be transformed into Ising model with an external field. Both interaction between spins and the 
external field are determined by the elements of payoff matrix and the preference parameter. In the 
case of perfect rationality at zero social temperature , this game model has three different phases 
which are entirely cooperative phase, entirely non-cooperative phase and mixed phase. In the 
investigations of the game model with Monte Carlo simulation, two paths of payoff and preference 
parameters are taken. In one path, the system undergos a discontinuous transition from cooperative 
phase to non-cooperative phase with the change of preference parameter. In another path, two 
continuous transitions appear one after another when system changes from cooperative phase to 
non-cooperative phase with the prefenrence parameter. The critical exponents v, 8 and y of two 
continuous phase transitions are estimated by the finite-size scaling analysis. Both continuous 
phase transitions have the same critical exponents and they belong to the same universality class 


as the two-dimensional Ising model. 


PACS numbers: 64.60.De, 05.40.Ca, 02.50.Le, 87.23.Ge 


INTRODUCTION 


The spatial evolutionary game has been minutely stud- 
ied to explain the emergence and maintenance of cooper- 
ation among selfish individuals during the past few years 
[1-4] in economics, biology and social sciences. 


The structure of social networks and the evolutionary 
rules are two important research fields of evolutionary 
game [5]. Many interesting results have been obtained 
on different spatial structures, such as two dimensional 
regular lattices [6, 7], small world networks [8] and scale- 
free networks [9]. Learning mechanism has been wide- 
ly adopted in evolutionary rules [5-7, 9]. Players revise 
their strategies by learning from their neighbors. Self- 
questioning mechanism is presented in Ref. [10]. Each 
player adopts its anti-strategy to play a virtual game with 
all its neighbors, then obtains a virtual payoff. By com- 
paring the real payoff and the virtual payoff, each player 
can get its optimal strategy corresponding to the highest 
payoff [10-12]. This evolutionary rule is similar to Ising 
model’s Metropolis algorithm in statistical physics. 

Traditional economic theory predicts that individuals 
will not supply goods and services without being com- 
pensated. However, individuals do not always pursue 
self-interest: people risking their own life to rescue oth- 
ers, soldiers participating in wars voluntarily, many kinds 
of charity etc [13]. Nowak summarized five possible rules 


for the evolution of cooperation corresponding to differ- 
ent situations: Kin selection, Direct reciprocity, Indirect 
reciprocity, Network reciprocity, Group selection [4]. In 
economics, altruistic and spiteful preferences have been 
introduced to study evolutionary stability of altruism and 
spitefulness [13-16]. In this paper, altruism, egoism and 
spitefulness are considered through a preference param- 
eter p. When p > 0, player is altruistic, which means a 
player has a positive regard for his opponents. p = 0 rep- 
resents the player as selfish. p < 0 determines the player 
as spiteful. 


In statistical physics, the internal energy decreases and 
approaches a minimum value at equilibrium in a closed 
system with constant external parameters and entropy 
(Principle of minimum energy) [17]. Similarly, in eco- 
nomics, profit maximization is an eternal pursuit to the 
individual and society, so one may expect that the equi- 
librium probability distribution function of payoffs in a 
closed system of agents has the Boltzmann-Gibbs for- 
m [18]. In analogy to Ising model, spatial evolution- 
ary game model can convert into Ising-like model, the 
effective Hamiltonian of evolutionary game can be ob- 
tained. By analyzing the effective Hamilton of game, 
game model is divided into three different phases: entire- 
ly cooperative phase (ferromagnetic order upward), en- 
tirely non-cooperative phase (ferromagnetic order down- 
ward), mixed phase (anti-ferromagnetic order) at zero 


social temperature (the noise introduced to permit ir- 
rational choices [6, 7]). Two paths (the phase of game 
model translating from entirely cooperative phase to en- 
tirely non-cooperative phase) are investigated. Continu- 
ous and discontinuous phase transitions are observed at 
sufficiently low temperature. Fourth-order cumulant is 
investigated to locate critical points. The critical expo- 
nents (v, 8, y) are obtained by finite-size scaling. 

This paper is organized as follows. In section I, we 
make a brief review of Ising model with a nonzero field 
firstly, then we introduce our evolutionary game model 
and obtain the effective Hamilton of game model. Final- 
ly, the ground state of game model is divided into three 
phases in the condition of perfect rationality; in section 
III, we present and discuss the results; in section IV, we 
draw a conclusions from the results. 


MODEL 
A brief review of Ising model 


The Hamiltonian of Ising model with an interaction 
Jij for any two adjacent sites 7 and j and an external 
magnetic field h; for any site 7 is given by 


E = — 5 Jig S483 = DSi, (1) 


<ij> 


where S; is the Ising spin (S; = +1) at lattice site i, 
the first sum is over pairs of adjacent spins (every pair is 
counted once). The notation < ij > indicates that sites 
i and j are the nearest neighbors. 

Ising models can be classified according to the sign of 
the interaction: for Jij > 0 the interaction is ferromag- 
netic and it is antiferromagnetic if Jj; < 0; when Jj; = 0, 
the spins are noninteracting. Additionally, the spin site 
wants to line up with the external field, for h; > 0 the 
spin site ¿į desires to line up in the positive direction and 
it desires to line up in the negative direction if h; < 0; 
when h; = 0, there is no external influence on the spin 
site. For h; = 0, the Ising model is symmetric under 
switching the value of the spin in all the lattice sites, 
but a non zero field breaks this symmetry. The intro- 
duction of nonzero magnetic field destroys the continu- 
ous phase transition of the ferromagnetic Ising model, 
whereas the nonzero uniform field does not destroy the 
transition of the antiferromagnetic Ising model. The ex- 
act solution of antiferromagnetic Ising model in an ex- 
ternal field can not be obtained. Instead, the researchers 
focus on the critical line (Néel temperature as a func- 
tion of external field) for the square lattice antiferromag- 
netic Ising in an external field[19-23]. For critical line, 
there are different approximations [20, 22, 24], for exam- 
ple cosh(h/T,.) = sinh?(2J/T,). The ends of the (T, h) 
critical line are (2.269, 0) and (0, 4|J|), and the antiferro- 


magnetic phase is completely enclosed by transition lines 
[25]. 

At zero temperature, a critical magnetic field he ex- 
ist in antiferromagnetic Ising model such as he = 4|J| 
for a square lattice. When —4J < h < 4J, the antifer- 
romagnetic order-states are preserved even though the 
magnetic field tries to align all spins along its direction. 
When h > 4J or h < —4J, ferromagnetic ordered-states 
dominate. 

In order to obtain energy difference AE (i flips its di- 
rection S; — —S;), the Eq. 1 can be rewritten as 


/ / 
E = -— 5 Tug Se85—- Si X Jys +Y hkSk—hiSi, (2) 
k 


<kj> Jj 


where k is a spin except i. When the state of i flips, the 
new energy E’ is 


i / 
El =- SO Ing Se55 + SiS Fig Sy +Y hkSk + hisi. 


(3) 


<kj> a k 
Thus, the energy difference AE = F’ — E is 


AE = 28; ` Ji3 Sj + 2h; Sj. (4) 
j 


Introduction of game model 


For a randomly given agent 7, two available strate- 
gies cooperation (S; = +1) and non-cooperation (S; = 
—1) can be adopted to play with its nearest neighbors. 
Mutual cooperation yields the reward a, mutual non- 
cooperation leads to punishment d, and the mixed choice 
gives the cooperator the suck’s payoff b and the non- 
cooperation the temptation c. 

The randomly chosen player i revises its strategy ac- 
cording to self-questioning mechanism and the stochastic 
evolutionary rule. That is to say, player i adopts its anti- 
strategy to play a virtual game with all its neighbors, 
and calculates the virtual payoff. By comparing the re- 
al payoff and the virtual payoff, player will find out its 
optimal strategy [10, 11]. In next round, player i will re- 
vise its current strategy to its anti-strategy with a given 
probability 


AG; 

W; = min{1, eT}, (5) 
where AG; = Gi, — Gi, Gi and G’, are the real and vir- 
tual payoff of player i, respectively. The noise can be 
described via T. The G; is defined as 

Gi = gi + Dg), (6) 


where g; represents the total payoff of player i (player i 
plays with all its nearest neighbors and accumulates the 


obtained payoff). g; represents all its nearest neighbors’s 
total payoff by playing with i. p is preference parameter, 
positive denotes altruism, negative stands for spite, and 
zero characterizes classical own profit maximization. 

This evolutionary rule is similar to single spin-flip of 
Ising model in statistical physics. We will find out the 
relationship between evolutionary game model and Ising 
model hereafter. 

For a given agent i, the number of cooperative and 
non-cooperative neighbors are n;i} and nj;_, 


me a 
=a Z (7) 


at 3j- Es (8) 


j 


Ni+ = 


where j is the neighbors set of agent i, k; is the sum of 
neighbors. 

By playing the game with all its nearest neighbors, 
agent 7 acquires its payoff g;. At the same time, it- 
s neighbors acquire g; in this process. when S; = +1, 
gi = anjs + bni- and gi = ani+ + cni—; when S; = —1, 
gi = cm + dni- and gi = bny4 + dni_. 

In the process of virtual game (corresponding to i flips 
its direct in Ising), S; > — Si, the payoffs difference are 
Ag; and Agi. They can be calculated as 


Ag = Si [(cni + dni—) = 
Ag; = Si[(bni+ + dni—) — 


(ani + bni-)], (9) 
(aniy + Cni— Ne (10) 


In our model, players care not only about their own 
monetary payoffs, but also about their opponent’s mon- 
etary payoffs. Thus, the play i does not necessarily max- 
imize payoff itself, but rather weighted sums of own and 
opponent’s payoffs. The change of payoffs when the state 
of i flips: S; + — S; can be written as, 


AG; = Agi + pAg;. (11) 


By substituting Eq. 9 and Eq. 10 into Eq. 11, we 
obtain 


AG; = 5Si{[(c— d- a+b) +p(b-d-a+c)] X S; 


+[(c+d-—a-—b)+p(b+d-—a-—ce)]ki}. (12) 


Ising model in canonical ensemble is based on the 
Boltzmann-Gibbs law, which states that the probabili- 
ty distribution function (PDF) of energy E is P({S;}) = 
e PEAS) /Z, where 6 = 1/k,T, kp is Boltzmann con- 
stant, T is temperature and Z = 0, ePECS:}) is nor- 
malization constant. When T — 0, the system abides 
the Ising interactions and external field strictly. When 
T — oo, the system evolves randomly. By analogy with 
Ising model, one may expect that the equilibrium PDF of 
game payoff G in a closed system of game agents has the 
Boltzmann-Gibbs form P({G;}) = e®¢4S:})/Z, where 


B = 1/T, T is the effective social temperature, which 
measures the extent of noise. For convenience, we define 
the effective energy as Eeff = —G. Thus, the effective 
energy difference in this system is AE; = —AG;. accord- 
ing to Eq. 12, we obtain 


a+b)+p(b 


IDDE 
c)]ki}. (13) 


As the Ising model, the strength of interaction Jij and 
external field h; can be defined as 


t[(c+d—a—b)+p(b+d—-a 


a+b)+p(b—d—a+c)], (14) 


HE le+4 A OO eda Oe) 


Bopp = <[(c—d—a +b) + p(b-d—a+o)] D> SiS; 


(eng a—b)+p(b+d-a oD kisi- 


(16) 


As a special accommodation, we investigate weak Pris- 
oner’s Dilemma. We take a =a, b=0, c=1-—a,d=0 
and 1/3 < a < 1/2. Thus, the strength of interaction, 
external field and effective energy can be written as 


Jy = - 71 - 20)(1 +p), (17) 


1 
Bopp = 7(1—2a)(1+p) NO 5:8; +2 “= 2a—p ) 9 S 
<aj> 
(19) 
For two dimensional square lattices, k; = 4, the effective 
energy is 


1 
Bopp = G(1— 2a)(1 +P) XO 5,5; + (1-2a-p 


<aj> 


DS 


(20) 


Three phases of game model 


The ground state of game model at zero temperature 
can be divided though three equations: the strength of 
interaction J = 0, the external field h = 0 and the crit- 
ical external field h = 4|J|. Results of these functions 
are a = 1/2 or p = —1 for J = 0; a = 1/2(1 — p) for 
h = 0; a = 1/(2 + p) for h = —4J, and p = 0 forh=4J, 
which are shown in FIG. 1. Game model is divided into 
three phases: entirely cooperative phase (ferromagnetic 
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FIG. 1. The ground state at zero temperature on the (a, p) 
parameter space. Three phases can exist: four small up- 
ward arrows denote entirely cooperative phase (ferromagnetic 
order upward), four small downward arrows denote entirely 
non-cooperative phase (ferromagnetic order downward) and 
small arrows upward and downward alternatively denote co- 
operative and non-cooperative coexistence (antiferromagnetic 
order). The phase transition and critical phenomena are in- 
vestigated by two special paths (two dash lines), which cross 
cooperative and non-cooperative region. 


order upward), entirely non-cooperative phase (ferromag- 
netic order downward), mixed phase (anti-ferromagnetic 
order). The region of cooperative and non-cooperative 
coexistence is enclosed by the critical lines (p = 0 and 
a = 1/(2+p)). In game model, T is the measure of 
stochastic uncertainties (noise) allowing the irrational 
choices. a is a inherent parameter, which belongs the 
payoff matrix. when a > 0.5, cooperation will gain much 
more benefit; when a < 0.5, non-cooperation will get 
more. But cooperation can survive for a < 0.5 owing 
to altruism. p as a preference parameter measures the 
relationship between spitefulness, egoism and altruism. 
Non-cooperation can arise only spitefulness existing. 


RESULTS AND DISCUSSIONS 


We have preformed Monte Carlo simulations on square 
lattice with periodic boundary conditions using Metropo- 
lis algorithm. The randomly chosen player i revises its 
strategy according self-questioning rule. In general, we 
discarded the first 10000 Monte Carlo Steps (MCS) in or- 
der to achieve the stationary regime for all lattices sizes. 
In order to estimate the quantities of interest, we con- 
sidered the next 2 x 10° MCS to calculate the averages. 
To further improve accuracy, the final results are aver- 
age over 100 independent realization with different initial 
configurations. 

Magnetization is the order parameter of ferromagnetic 


Ising. Staggered magnetization is the order parameter 
of antiferromagnetic Ising. In order to obtain the for- 
mula of order parameter. The two-dimensional square- 
lattice is divided into two sublattices, one includes all 
spins up another includes all spins down for antiferromag- 
netic Ising model. We calculated the sublattice magneti- 
zation per spin, mı and mz, defined as mı = 2()°, S:)/N 
and m2 = 2()7, 55)/N, where S; is the spin of the first 
sublattice, and S; is the spin of the second sublattice. 
The total magnetization which is the order parameter of 
ferromagnetic systems can be defined as 

Mi = = (mı + mz). (21) 
For antiferromagnetic Ising model, the staggered magne- 
tization can be defined as 


1 
Ms = zm — mal, (22) 


which is the order parameter for antiferromagnetic sys- 
tems [26, 27]. The corresponding susceptibilities are de- 
fined by 

x(m) = N[< m? >- <m>’, (23) 


and the fourth-order Binder cumulants is 


where m can be m; or ms for x(m) and U(m). 

Mi, Ms, x(m) and U(m) obey the following finite size 
scaling relations in the neighborhood of the stationary 
critical point pe: 


my(p) = LP m (Le), (25) 
xL(p) = L” xo(L™” e), (26) 
Ur (p) = Up(L'/“e), (27) 


where € = (p — pe)/Pe, Pe is the critical preference pa- 
rameter for a given T. 
The derivative of fourth-order Binder cumulants Uz (p) 
is 
ots) 
Pe ` 


Uz (p) = L” (28) 
We can obtain the critical exponent v from a log-log plot 
of Ut (pe) versus L. 

In this model, the evolution of game model from entire- 
ly cooperative phase to entirely non-cooperative phase is 
an interesting problem which involves the interaction be- 
tween game’s parameter a and individual preference p at 
low social temperatures. Thus, two special evolutionary 
paths a = 1/2p + 0.6 and a = 1/2p + 0.4 (broken lines 
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FIG. 2. Magnetisation as a function of p for several lat- 
tice sizes L along the path a = 1/2p + 0.6, magnetisation is 
discontinuous at transition point (p = —0.1, a = 0.55). 


FIG. 3. Staggered magnetization Mms for various system 
sizes along the path a = 1/2p + 0.4 at T = 0.02. Apparently, 
two critical points exist, because of the finite-size effects near 
p = 0 and p = 0.15 have been observed. 


in FIG. 1) are taken. The path a = 1/2p + 0.4 passes 
through the antiferromagnetic region. 

In FIG. 2, magnetisation as a function of p for several 
lattice sizes L is shown at T = 0.002. The value of the 
magnetization m jumps from +1 to —1 as the preference 
parameter p is scanned from the positive direction to the 
negative direction by the path a = 1/2p + 0.6 of FIG. 1. 
The order parameter of magnetisation m+ is discontinu- 
ous. Obviously, the critical exponent 6/v = 0, indicate 
a discontinuous phase transition. 

Theoretically, the phase transition sweeping along path 
a = 1/2p + 0.6 is a transition from ferromagnetic order 
upward to ferromagnetic order downward. This is equiv- 
alent to a magnetic material placed in an external field 
h. If the temperature is lower than Te (critical temper- 
ature at the intersection of h = 0 and a = 1/2p + 0.6), 
the value of the magnetization m jumps from positive to 
negative as the external magnetic field h is scanned from 
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FIG. 4. Susceptibility as a function of p for various sys- 
tem sizes along the path a = 1/2p + 0.4 at T = 0.02. The 
susceptibility has sharp jump near p = 0 and p = 0.15. 


the positive direction to the negative direction. Consider 
the 2D Ising model on a square lattice, the critical tem- 
perature is Te = 2.269J = 0.00225 at transition point 
(p = —0.1, a = 0.55). 

In FIG. 3, The order parameter of antimagnetisation 
Ms as a function of p for several lattice sizes L is shown 
at T = 0.02. The staggered magnetization changes with 
the lattice sizes near critical points. In FIG. 4, suscepti- 
bility as a function of p for various system sizes is shown. 
The susceptibility has two maximum whose position shift 
toward the critical values as one increase L. As one in- 
creases L the peak around the critical point increases. 
Those phenomena display remarkable finite-size effects. 
There are two critical points existing. To see them more 
clearly, we narrow down the range of p to redraw the stag- 
gered magnetization (FIG. 5, FIG. 6) and susceptibility 
(FIG. 7, FIG. 8). 

Theoretically, path a = 1/2p + 0.4 intersects anti- 
ferromagnetic critical line. The antimagnetic phase 
transition is a second-order transition. In this situ- 
ation, J = —(0.2 — p)(1+ p)/4, h = 2p — 0.2 and 
the approximate critical line is cosh(2p—0.2/T.) = 
sinh? |(p — 0.2)(1 + p)/(2T.)]. Two intersection can be 
obtained by solving this equation at Te = 0.02, pe = 
0.01167 and pe = 0.131426. 

To locate the two critical points by using Monte Carlo 
simulations, we plot the reduced fourth-order cumulant, 
respectively. The fourth-order cumulant of the left phase 
transition point in FIG. 3 is shown in FIG. 9 as a func- 
tion of p for several values of L. The scaling relation 
for the fourth-order cumulant shows that, at the critical 
preference parameter, all curves must cross at a common 
point. From the crossing of these curves, we estimate 
the critical preference parameter pe = 0.01127 + 0.00014. 
The fourth-order cumulant of the right phase transition 
point in FIG. 3 is shown in FIG. 10 as a function of p 
for several values of L. The critical preference parameter 
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FIG. 5. The Staggered magnetization of the left critical point 
in FIG. 3 near p = 0. 
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FIG. 6. The Staggered magnetization ms of the right critical 
point in FIG. 3 for various system sizes along the path a = 
1/2p + 0.4 near p = 0.15. 


is pe = 0.13156 + 0.00008. Critical points are in good a- 
greement with the one found from theoretical prediction 
(pe = 0.01167 and pe = 0.131426). 


In order to compare the critical phenomena with Ising 
model, we evaluate the critical exponents via finite size 
scaling relations in FIG. 11. The log-log plots of mz (p) 
as function of L at the critical points pe = 0.01127 and 
Pe = 0.13156 are shown at FIG. 11(a) and FIG. 11(b), 
respectively. The best fit to the data points furnishes the 
value 8/v = 0.116 + 0.0093 at pe = 0.01127. When pe = 
0.13156, the value is 8/v = 0.1135 + 0.00702. FIG. 11(c) 
and FIG. 11(d) show the log-log plot of susceptibility 
XL(pe) vs L at the critical points pe = 0.01127 and pe = 
0.13156, respectively. the slope of the fitting lines are 
y/v = 1.749+0.0212 at pe = 0.01127, and y/v = 1.736 + 
0.0405 at pe = 0.13156. The log-log plots of U; (p) as 
function of L at the critical points pe = 0.01127 and 
Pe = 0.13156 are shown at FIG. 11(e) and FIG. 11(f), 
respectively. The solid lines are the best fit with slope 
1/v = 0.977 + 0.0391 at pe = 0.01127, and 1/v = 0.982 + 
0.0296 at pe = 0.13156. 
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FIG. 7. The susceptibility of the left critical point in FIG. 4 
for varying lattice size near p = 0. 
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FIG. 8. The susceptibility of the right critical point in FIG. 
4 as a function of p for various system sizes along the path 
a = 1/2p + 0.4 near p=0.15. 


CONCLUSIONS 


A general game model about economical and social ac- 
tivities is proposed in this paper. We can relate this game 
model with Ising model in statistical mechanics. The in- 
teraction between spins and external field of the Ising 
model are determined by the reward a of cooperation 
and the preference parameter p, which can be altruistic 
to spiteful. We have studied weak prisoner’s dilemma on 
a square lattice with periodic boundary condition. At 
zero social temperature without noise for irrational de- 
cision, there are three different phases: entirely cooper- 
ative phase (ferromagnetic order upward), entirely non- 
cooperative phase (ferromagnetic order downward) and 
mixed phase (anti-ferromagnetic order) . In the inves- 
tigation of evolution from entirely cooperative phase to 
entirely non-cooperative phase, two evolutionary path- 
s a = 1/2p + 0.6 and a = 1/2p + 0.4 have been tak- 
en. For the path a = 1/2p + 0.6, the sytem undergoes 
a discontinuous transition under a critical temperature. 
For the path a = 1/2p + 0.4, there are two continuous 
phase transitions at the critical points pe = 0.01127 and 
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FIG. 9. Fourth-order cumulant Uz (p) of the left critical point 
as a function of p. The intersection point is pe = 0.01127 + 
0.00014. 
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FIG. 10. Fourth-order cumulant Uz(p) of the right critical 
point as a function of p for various system sizes and T = 0.02. 
The intersection point is pe = 0.13156 + 0.00008. 


pe = 0.13156 respectively. The critical exponents 8/v, 
y/v and 1/v are estimated for the two critical points at 
a fixed reduced temperature T = 0.02. Within the error 
range of data, the critical exponents at pe = 0.01127 and 
Pc = 0.13156 are the same and equal to the results of 
two-dimensional Ising model. These results indicate that 
the continuous phase transitions of the game model be- 
long to the same universal class as the two-dimensional 
Ising model. 
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FIG. 11. Log-log plot of staggered magnetization mz (pe) vs 
L: (a) pe = 0.01127, the slope of fitting line is —8/v = 
—0.116 + 0.0093; (b) pe = 0.13156, the slope is —8/v = 
—0.1135 + 0.00702. Log-log plot of susceptibility xz(pe) vs 
L: (c) pe = 0.01127, the solid line is the best fit with s- 
lop y/v = 1.749 + 0.0212; (d) y/v = 1.736 + 0.0405 at 
De = 0.13156. Log-log plot of U; (pe) vs L: (e) pe = 0.01127, 
the solid line is the best fit with slop 1/v = 0.977 + 0.0391; 
(£) 1/v = 0.982 + 0.0296 at pe = 0.13156. 
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